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We study the phase diagram at T — of the antiferromagnetic Heisenberg model on the triangular 
lattice with spatially-anisotropic interactions. For values of the anisotropy very close to J a /J/3 = 0.5, 
conventional spin wave theory predicts that quantum fluctuations melt the classical structures, for 
S = 1/2. For the regime Jp < J a , it is shown that the incommensurate spiral phases survive until 
J/3 1 Ja = 0.27, leaving a wide region where the ground state is disordered. The existence of such 
nonmagnetic states suggests the possibility of spin liquid behavior for intermediate values of the 
anisotropy. 



For a long time frustrated quantum antiferromagnets 
have been intensively studied. In this context, the an- 
tiferromagnetic Heisenberg model on a triangular lat- 
tice is a prototype for such systems. From the propo- 
sition of Anderson and Fazekas that this model is a can- 
didate to exhibit spin liquid behavioio, a lot of work 
was done to understand the nature of its ground state. 
Although there is a general conviction that the ground 
state is ordered with a magnetic vector Q = (4tt/3, 0)H'H, 
some authors found a situation very close to a critical 
one or no magnetic order at all, leaving the answer still 
controversialau. A systematic way to study the role of 
frustration is to vary the strength of the exchange interac- 
tion along the bonds. Recently Bhaumik et aln explored 
the existence of collinear phases on triangular and pen- 
tagonal lattices and proposed that the critical value of the 
anisotropy, below which the ground state has collinear 
order, can be taken as a measure of frustration. 

From the experimental point of view, the unconven- 
tional properties of the organic superconductors k — 
(BEDT - TTF) 2 X and their similarities with the 
cupratesu renewed the interest in the triangular topology. 
In particular, it was argueduEl that the Hubbard model on 
a triangular lattice with anisotropic interactions at half 
filling could be a good candidate to explain such prop- 
erties. In the limit of strong coupling this model can be 
mapped to the Heisenberg model with anisotropic inter- 
actions J a = t 2 a /U, Jp = tp/U where t a and tp are the 
anisotropic hoppings. Furthermore, experiments suggest 
that the relevant values of J a /Jp are about 0.3—1 (see for 
details Ref.EI), so the combined effect of anisotropy and 
frustration will take an important role in these materials. 

In this paper we address the phase diagram of the 
Heisenberg model on the triangular lattice with spatially- 
anisotropic interactions by mean of conventional spin 
wave theory. Our approach provides the values of 
anisotropy where nonmagnetic states appear signaling 
the possible existence of spin liquid behavior. 

The Hamiltonian is: 



r,<5 a 

where J a and Jp are positive and correspond to interac- 
tions along directions 5 a and 8p respectively (see figure 
1). 




FIG. 1. Structure of the anisotropic bonds in a triangular 
lattice. 

In order to develop a linear spin wave theory, we need 
to know previously the classical phase diagram. Basi- 
cally, we replace the spin operators by classical vectors 
on the x — y plane and minimize the energy which is 
equivalent to find the magnetic vector Q satisfying: 

Jq < ^k,V k 

where 

k x k V3 
Jk = J a cos(k x ) + Jp2 cos(-^) cos( v ) (2) 

The minimization of eq.(^|) can be carried on easily for 
each value of /x = J a j Jp and it can be shown that there 
are two kinds of phases: 

• Collinear: this state is characterized by Q co / = 
(0, 27r/v / 3), and it is stable in the region < fi < 
0.5. The case \i = is topologically equivalent to a 
square lattice and Q co ; on a triangular lattice pro- 
duces the same magnetic structure than (tt, tt) on 
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a square one. 



with 



• Incommensurate spiral: in this state Q sp i = 
(2Q, 0), where Q — cos _1 (— 1/2/z), and it is sta- 
ble in the region 0.5 < /i < oo. For /i = 1 we 
have the pure frustrated case which corresponds to 
the 120° commensurate spiral order and for ji = oo 
we have infinite decoupled classical chains each one 
Neel ordered. 

In figure 2 we represent the possible values of ±Q in the 
Brillouin zone for different values of /i. Using the invari- 
ance in k-space under translations G = (±27r, = f2tt/v3) 
we can see that the transition between all the possible 
states is continuous. 

(O.ZnHl ) 
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FIG. 2. Magnetic vectors ±Q for different values of fj, 
starting from /i = with (0, 27r/V3) and ending at /i — oo 
with (n,0), in the Brillouin zone. The equivalence between 
empty and filled circles, represented by dashed lines, shows 
the continuity of the classical transitions 

We are interested in how the transition between these 
classical sates is affected by quantum fluctuations. The 
strategy to perform the spin wave calculation is the one- 
sublattice description. We apply a uniform twist of the 
coordinate frame in such a way that x-axis direction coin- 
cides, in each site, with the direction of the classical struc- 
ture. This allows us to incorporate quantum fluctuations 
in a unique way for collinear and spiral phases. The next 
steps are well knownE2l and we only describe the proce- 
dure, i) The angular momentum operators are expressed 
by mean of the Holstein-Primakov transformation, ii) the 
Hamiltonian is expanded to order 1/S (quadratic order 
in bosons), iii) after Fourier transforming, the Hamilto- 
nian can be diagonalized by a Bogoliubov transformation 
resulting: 



7A(k)) 



where 

E c = N S 2 [J/3 cos(Q.Sfj) + J a cos(Q.S a ) + Jp cos(Q.5p)] 
and 



S 
2 



E Js cos(k.5) [l+cos(Q.S}]-2 cos(Q.S) 



S=S a ,6 3 



lB (k) = S E J s cos(h.S) [cos(Q.6)-l] 

6=5 a ,6 f3 

The compact equation (||) gives the dispersion relation 
for all the different phases labeled by Q. In particu- 
lar, for \i = we recover the spin wave spectrum of the 
square lattice while for /i — 1 we obtain the triangular 
one (spatially isotropic). Independently of the value of 
Q it can be checked that E(k) — for k = 0, ±Q, and 
these zero-modes are the three Goldstone modes related 
to the complete symmetry-breaking of the SU (2) invari- 
ance. However, for collinear phase Q is equivalent to — Q 
and two zero-modes are recovered. Maybe the most in- 
teresting result is that if we expand E(k) near these zeros 
the behavior of E(k) is linear for all fi ^ 1/2, while for 
/i = 1/2, around k = (0, 0) and along the direction of k x 
it becomes quadratic showing the softening of the spin 
wave modes for all S (see figure 3). 
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FIG. 3. Relation dispersion E(k) along k x direction for dif- 
ferent values of fj, = J a /J/3 and S — 1/2. 



This is manifested in the magnetization, 



k 



mo 



V3 
2 



DZ 



dk x dk y 7^(k)) 
(2tt) 2 2E(k) 



(4) 



£(k) = [ 7 i(k)- 7 |(k)]- 



(3) 



where the integration is over the Brillouin zone of the tri- 
angular lattice. In the second term of eq. ([|) the integrand 
diverge for k = 0, ±Q but the integral remains finite in 
2D for all /i ^ 1/2, while for fi — 1/2 quantum fluctu- 
ations are amplified, because of the quadratic, behavior 
of E(k) near k = (0, 0), and it can be provedEi that the 
integral contribute with a finite but large enhacement of 
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quantum correction to the magnetization. In order to 
estimate the region where the system is disordered for 
S = 1/2, we calculated the quantum corrected magne- 
tization for each classical structure. In what follows we 
rescale \i — ► 77 = /j/(1 + /-*)• This allows to capture all the 
possible values of /i in a finite range < 77 < 1. 



0.40 



0.30 



0.20 



0.10 



0.00 




collinear 



disorder 



FIG. 4. Quantum corrected magnetization Vs. r\ for spin 
S = 1/2. Dot-dashed line indicates the location of commen- 
surate Neel order. 

Figure 4 shows that spin wave theory predicts a collinear 
phase at 77 = with mo = 0.303 and as we increase the 
frustration it is weaken continuously getting disordered 
just before the classical value 77 = 1/3. Immediately after 
this value, an incommensurate order is stabilized starting 
from mo = and it becomes more robust as we approach 
the spatially isotropic case 77 = 0.5 where the structure 
is commensurate, Q =(47r/3, 0), and mo = 0.239. If we 
continue increasing 77 incommensurate structures appear 
again with decreasing mo until the critical value 77 = 0.79 
where magnetization vanishes. Beyond this value, the 
ground state is disordered. We note that the singular 
behavior obtained near 77 = 1/3 does not appear i» pre- 
vious studies of this model. In fact, Gazza et alr3 per- 
formed a Schwinger boson mean field theory and found 
a continuous transition from collinear to spiral phases 
at 77 = 0.375 but with a nonvanishing magnetization 
77i ~ 0.175. However, inclusion of gaussian fluctuations 
in this theory would tend to decrease the Meter, as it is 
known to occur in highly frustrated casesE3u, reaching 
probably more accord with our spin wave results. The 
same happens wit h both theories in the J\ — J2 model 
on a square latticeE^t-aO. One should take into account 
that our system can be thought as a Heisenberg model 
on a square lattice with interactions to first anxLsecond 
neighbours, but only along one of the diagonals^. 

On the other hand, for the regime Jp < J a , the crit- 
ical value 77 = 0.79 means that the system disorders at 
Jp/Ja = 0.27. This should be compared with the spin 



wave value for the square caseS, J±/J\\ ~ 0.03, where 
the difference in one order of magnitude shows that the 
way in which fluctuations overcome the ordering is dif- 
ferent. However, in the regime around 77 = 1 the spin 
wave calculation is not reliable any more since quantum 
fluctuations are divergent in the ID limit. In particular, 
numerical techniquescJ predict that in the square case an 
infinitesimal coupling is required to take the chains away 
from criticality and get ordered. A similar calculation 
should be done for our model in the regime of weakly 
coupled chains and it is left for a future work. 

In conclusion, we have studied the Heisenberg model 
on a triangular lattice with spatially-anisotropic interac- 
tions by mean of a spin wave analysis. We calculated the 
classical and quantum corrected phase diagram at T = 
for the whole range of parameters 77 = J a /{J a + Jp) ob- 
taining different regimes: collinear, incommensurate spi- 
rals and disorder phases. The nonmagnetic region found 
very near the singular value 77 = 1/3 for S = 1/2 sug- 
gests the possible existence of a spin liquid phase. A 
similar scenario occuisan the J\ — J2 and J\ — J3 model 
on a square latticeEj'ES. It is clear from our approxima- 
tion that it should be more probable to find a spin liquid 
behavior near 77 = 1/3 than in other region of the dia- 
gram between collinear and spiral phases. Though this 
region is small, it is just located in the range where the 
experimental values of J a j Jp are relevant for organic su- 
perconductors k- (BEDT -TTF) 2 X. Moreover, in the 
regime of Jp < J a we found that quantum fluctuations 
destroy the order at Jp/J a — 0.27 leaving a wide region 
where the ground state is disordered. 

Finally, we would like to stress that by applying a 
simple approximation like spin wave theory we have ob- 
tained a very rich phase diagram. Of course, we have not 
demonstrated the existence of spin liquid phases but the 
appearance of nonmagnetic regions indicates the possi- 
ble location of them. Another quantities like spin gap or 
correlation functions are needed to explore more deeply 
the nature of these phases, and it requires more powerful 
techniques. 

The author acknowledges the useful discussions with 
A. Ceccatto, S. Sorella and E. Jagla. This work was sup- 
ported by Consejo Nacional de Investigaciones Cientfficas 
y Tecnicas of Argentina. 

Note added: during revision of this work we became 
aware of two recent works-performed on this model. The 
first one by Zheng et alrB using series expansion tech- 
nique where their prediction are, in general, similar to the 
phase diagram, obtained in this work. The second one, 
Merino et a/.Ej using the same technique of the present 
work. 



3 



1 P. Fazekas and P. W. Anderson, Phil. Mag. 30, 423 (1974). 

2 D. A. Huse and V. Elser. Phys. Rev. Lett. 60, 2531 (1988); 
R. Deutscher and H. U. Everts, Z. Phys. B 93, 77 (1993). 
Phys. Rev. Lett. 60, 2531 (1988); B. Bernu, C. Lhuillier, 
and L. Pierre, Phys. Rev. Lett. 69, 2590 (1992); B. Bernu, 
P. Lecheminant, C. Lhuillier, and L. Pierre, Phys. Rev. B 
50, 10048 (1994). 

3 L. O. Manuel, A. E. Trumper, and H. A. Ceccatto, Phys. 
Rev. B 57, 8348 (1998). 

4 H. Nishimori and H. Nakanishi, J. Phys. Soc. Jpn 57, 626 
(1988); 58, 2607 (1989); 58 3433 (1989); N. Eltsner, R. 
R. P. Singh, and A. P. Young, Phys. Rev. Lett. 71 , 1629 
(1993); K. Yang, L. K. Warman , and S. M. Girvin, Phys. 
Rev. Lett. 70, 2641 (1993). 

5 P. W. Leung and K. Runge, Phys. Rev. B 47, 5861 (1993). 

6 U. Bhaumik and I. Bose, Phys. Rev. B 58, 73 (1998). 

7 H. Kino and H. Fukuyama, J. Phys. Soc. Jpn. 65, 2158 
(1996). 

8 R. H. McKenzie, Science 278, 820 (1997). 



J R. H. McKenzie, preprint |cond-mat/9802198 

10 Th. Jolicoeur and J. C. Le Guillou, Phys. Rev. B 40, 2727 
(1989), S, J. Miyake, J. Phys. Soc. Jpn. 61, 983 (1992), A. 
Chubukov, S. Sachdev, and T. Senthil, J. Phys.: Condens. 
Matter 6, 8891 (1994). 

11 C. J. Gazza and H. A. Ceccatto, J. Condens. Matt. 5, L135 
(1993). 

12 A. E. Trumper, L. O. Manuel, C. J. Gazza, and H. A. 
Ceccatto, Phys. Rev. Lett. 78, 2216 (1997), 

13 P. Chandra and B. Doucot, Phys. Rev. B 38, 9335 (1988). 

14 F. Mila, D. Poiblanc and C. Bruder, Phys. Rev. B 43, 7891 
(1991). 

15 T. Sakai and M. Takahashi, J. Phys. Soc. Jpn. 58, 3131 
(1989). 

16 A. Parola, S. Sorella, and Q. F. Zhong, Phys. Rev. Lett. 
71, 4393 (1993), 2158 (1996). 

17 S. R. White and I. Affleck, Phys. Rev. B 54, 9862 (1996). 

18 P. Locher, Phys. Rev. B 41, 2537 (1990). 

19 Z. Weihong R. H. Mckenzie and R. R. P. Singh. Icond- 



mat/9812262 . 



^J. Merino, R. H. M ckenzie, J. B. Marston and C. H. Chung. 
cond-mat/9812429 . 



4 



